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Abstract. It is well known, and easy to see, that not each nondetermin- 
istic Biichi automaton on infinite words can be simulated by a nonde- 
terministic co-Biichi automaton. We show that in the cases when such a 
simulation is possible, the number of states needed for it can grow nonlin- 
early. More precisely, we show a sequence of - as we believe, simple and 
elegant - languages which witness the existence of a nondeterministic 
Biichi automaton with n states, which can be simulated by a nondeter- 
ministic co-Biichi automaton, but cannot be simulated by any nonde- 
terministic co-Biichi automaton with less than c * n 7//6 states for some 
constant c. This improves on the best previously known lower bound of 
3(n-l)/2Q 



1 Introduction 

1.1 Previous work 

In 1962 Biichi was the first to introduce finite automata on infinite words. He 
needed them to solve some fundamental decision problems in mathematics and 
logic ([2], [6] [7]). They became a popular area of research due to their elegance 
and the tight relation between automata on infinite objects and monadic second- 
order logic. Nowadays, automata are seen as a very useful tool in verification and 
specification of nonterminating systems. This is why the complexity of problems 
concerning automata has recently been considered a hot topic (e. g. (5], [T]). 

To serve different applications, different types of automata were introduced. 
In his proof of the decidability of the satisfiability of SIS, Biichi introduced 
nondeterministic automata on infinite words (NBW), which are a natural tool 
to model things that happen infinitely often. In a Biichi automaton, some of 
the states are accepting and a run on an infinite word is accepting if and only 
if it visits some accepting state infinitely often (|2]). Dually, a run of co-Biichi 
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automaton (NCW) is accepting if and only if it visits non-accepting states only 
finitely often. There are also automata with more complicated accepting condi- 
tions - most well known of them are parity automata, Street automata, Rabin 
automata and Muller automata. 

As in the case of finite automata on finite words, four basic types of transition 
relation can be considered: deterministic, nondeterministic, universal and alter- 
nating. In this paper, from now on, we only consider nondeterministic 
automata. 

The problem of comparing the power of different types of automata is well 
studied and understood. For example it is easy to see that not every language 
that can be recognized by a Biichi automaton on infinite words (such languages 
are called w-regular languages) can be also recognized by a co-Biichi automaton. 
The most popular example of cj-regular language that cannot be expressed by 
NCW is the language L — {w\w has infinitely many O's} over the alphabet {0, 1}. 
On the other hand, it is not very hard to see that every language that can be 
recognized by a co-Biichi automaton is w-regular. 

As we said, the problem of comparing the power of different types of automata 
is well studied. But we are quite far from knowing everything about the number 
of states needed to simulate an automaton of one type by an automaton of 
another type - see for example the survey [3] to learn about the open problems 
in this area. 

In this paper we consider the problem of the cost of simulating a Biichi 
automaton on infinite words by a co-Biichi automaton (if such NCW exists), left 
open in [3J: given a number n £ Af, for what f(n) can we be sure that every 
nondeterministic Biichi automaton with no more than n states, which can be 
simulated by a co-Biichi automaton, can be simulated by a co-Biichi automaton 
with at most /(n) states? 

There is a large gap between the known upper bound and the known lower 
bound for such a translation. The best currently known translation goes via 
intermediate deterministic Street automaton, involving exponential blowup of 
the number of states (|8], [l]). More precisely, for NBW with n states, we get 
NCW with 2°(nlogn) states. For a long time the best known lower bound for 
/ was nothing more than the trivial bound n. In 2007 it was shown that there 
is an NBW with equivalent NCW such that there is no NCW equivalent to this 
NBW on the same structure ([!]). The first non-trivial (and the best currently 
known) lower bound is linear - the result of [l] is that, for each n e Af, there 
exists a NBW with n states such that there is a NCW which recognizes the 
same language, but every such NCW has at least 3(n — l)/2 states. 

There is a good reason why it is hard to show a lower bound for the above 
problem. The language (or rather, to be more precise, class of languages) used 
to show such a bound has to be hard enough to be expressed by a co-Biichi 
automaton, but on the other hand not too hard, because some (actually, most 
of) w-regular languages cannot be expressed by NCW at all. The idea given 
in the proof of 3(n — l)/2 lower bound in |T], was to define a language which 
can be easily split into parts that can by recognized by a NBW but cannot by 
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recognized by a NCW. The language they used was Lk = {w S {0, 1} W | both 
and 1 appear at least k times in w}. Let L\ = {w E {0, l}"|z appears infinitely 
often in w and (1 — i) appear at least k times in w}, then it is easy to see that 
Lk = L\ ULj,, L\ can be recognized by Biichi automata of size k and L k cannot 
by recognized by any co-Biichi automaton. It is still, however, possible to built 
a NCW that recognizes Lk with 3fc + 1 states and indeed, as it was proved in 
[T], every NCW recognizing Lk has at least 3fc states. 

1.2 Our contribution — a nonlinear lower bound 

In this paper we give a strong improvement of the lower bound from |TJ. We 
show that, for every integer k, there is a language Lk such that Lk can be 
recognized by an NBW with 0(k 2 ) states, whereas every NCW that recognizes 
this language has at least 0(k 7 ^ 3 ) states. Actually, the smallest NCW we know, 
which recognizes Lk, has 0(k 3 ) states, and we believe that this automaton is 
indeed minimal. In the terms of function / from the above subsection this means 
that / equals at least cn 7 / 6 for some c (this is since n is 0{k 2 )) and, if our 
conjecture concerning the size of a minimal automaton for Lk is true, / would 
equal at least cn 3 / 2 for some constant c. 

The technical part of of this paper is organized as follows. In subsection |2.1| 
we give some basic definitions. In subsection |2.2| the definition of the language Lk 
is presented. Also in this section we show how this language can be recognized 
by a Biichi automaton with 0(k 2 ) states and how Lk can be recognized by a 
co-Biichi automaton with 0(k 3 ) states. The main theorem, saying that every 
co-Biichi automaton that recognizes Lk has at least 0(k 7 ^ 3 ) states is formulated 
in the end of subsection |2.2| and the rest of the paper is devoted to its proof. 

2 Technical Part 

2.1 Preliminaries 

A nondeterministic lo- automaton is a quintuple (ZJ,Q,qo,6,a), where S is an 
alphabet, Q is a set of states, qo e Q is an initial state, SCQxExQ is & 
transition relation and a C Q is an accepting condition. 

A run of w-automaton over a word w = w±W2 ■ ■ ■ is a sequence of states 
9091 <Z2 • ■ • such that for every i > 0, € Q and (qi, KJj+i, qi+i) G S. 

Depending on type of the automaton we we have different definitions of 
accepting run. For a Biichi automaton, a run is accepting, if it visits some state 
from accepting condition a infinitely often. In the case of a co-Biichi automaton, 
a run is accepting, if only states from the set a are visited infinitely often in this 
run. For a given nondeterministic w-automaton A and a given word w, we say 
that A accepts w if there exists an accepting run of A on w. The words accepted 
by A form the language of A, denoted by L(A). 

We say that a co-Biichi automaton A = (E,Q,qo,5,a) is in the normal 
form iff for each (q, a, q') S 5 if q is in a, then also q' is in a. Note that for a 
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given NCW A = (E, Q, q , 6, a) the automaton A' = (E, Q', (q , 0),S', a x {1}), 
where Q' = Q x {0} U a x {1} and 5' = {((q,i),a, (q',j)) | (q,a,q') £ 5 A i < 
j A (q, i), (q',j) £ Q'} is in the normal form, recognizes the same language and 
has at most 2\Q\ states. 

For a given word w — W\,W2, ■ ■ ■ , let w[i,j] = Wi, tOj+i, . . . , Wj and let 
w[i, oo] = Wi,Wi+i, 

An accepting run qo, q%, . . . on a word w = w\,W2, ■ ■ ■ of a co-Buchi automa- 
ton in the normal form is called shortest, if it reaches an accepting state as early 
as possible, that is if for each accepting run po,Pi, ... of this automaton on w it 
holds that if p, £ a then also % £ a. 

2.2 Languages Lk and their automata 

Let k > 64 be a - fixed - natural number and let 21^ = {1,2 ... k}. The set 
Sk = {a,, a \ a E 2l2fc} will be the alphabet of our language Lk- 

Let us begin with the following informal interpretation of words over E^. 
Each symbol j £ Ek should be read as "agent j makes a promise". Each symbol 
j £ Ek should be read as "j fulfills his promise". The language Lk consists 
(roughly speaking) of the words in which there is someone who at least 2k times 
fulfilled his promises, but there are also promises which were never fulfilled. 

To be more formal: 

Definition 1. For a word w £ E£ , where w = W1W2 ■ ■ ■ and i £ Af, define the 
interpretation hi{w) as: 

— hi{w) = jj if Wi £ 2l 2 fe and Wi occurs in w[i+ 1, 00]; (it is the fulfillment that 
counts, not a promise). 

— hi(w) — if Wi £ 2l2fc and Wi does not occur in w[i + l,oo]; (unfulfilled 
promises are read as 0). 

— Suppose Wi — s for some s £ 2l2fe- Then hi{w) — s if there is j < i such that 
Wj = s and s does not occur in the word w[j, i — 1], and hi{w) = jj if there 
is no such j (one first needs to make a promise, in order to fulfill it). 

The interpretation h(w) is now defined as the infinite word hi(w)h,2(w) .... 

Now we are ready to formally define the language L^: 

Definition 2. is the set of such words w £ E^ that: 

— either there is at least one in h(w) and there exists s £ %2k which occurs 
at least 2k times in h(w), 

— or there exists i such that hj(w) = jj for all j > i. 

It is easy to see that each w £ E^ satisfies at least one of the following three 
conditions: there is s £ %2k such that hi(w) = s for infinitely many numbers i, 
or there are infinitely many occurrences of in h(w), or there is only a finite 
number of occurrences of symbols from 2l-2fc in w. Using this observation, we can 
represent Lk in the following way: 




Fig. 1. The w-automaton recognizing Lk - all differences between NBW version 
and NCW version are in the body of Ai (fig. [2]). Label stands (for better 
readability) for alternative of every label except i. 




Fig. 2. Automaton A{ - the same for NBW and NCW, modulo the body of Bij 
(fig. |]for NBW and fig. gfor NCW) 



6 



Lk = {viw \v G Ef, A 

( (i G 2l2fc Awe (Sk \ {i}Y ^ 3j 6 2l 2 fc h m (viw) — j for infinitely many 

numbers to) (1) 

V (i G 2t2ft Awe \ {z})" A 3j G 2l 2 fe h m (viw) = j for at least 

2fc numbers to such that m < \v\) (2) 

v (we {!,..., 2krm (3) 




Fig. 3. Automaton Bij in the NBW case 



Keeping in mind the above representation, it is easy to build a small NBW 
recognizing Lk (see Figures [I] [2] and |3j . The accepting state on the bottom left 
of Figure [l] checks if condition (|3j is satisfied, and the other states (except of 
the states in the boxes Ai and of the initial state) check if the condition ^ is 
satisfied. Reading the input y the automaton first guesses the number j from 
condition Q and makes sure that j occurs at least 2k times in h(y). Then it 
guesses i from condition ([2J, accepts, and remains in the accepting state forever, 
unless it spots i. This part of the automaton works also correctly for the co-Biichi 
case. 

The most interesting condition is (JlJ. It is checked in the following way. At 
first, the automaton waits in the initial state until it spots i from condition ([TJ. 
Then, it goes to Ai, guesses j and goes to the module Bij, which checks if i 
does not occur any more, and if both j and j occur infinitely often. This can be 
summarized as: 

Theorem 1. Language Lk can be recognized with a nondeterministic Buchi au- 
tomaton with 0(k 2 ) states. 

Condition (JTJ cannot be checked by any NCW. However, it can be replaced 
by the condition 

i G 2l2fc Awe (Sk \ A 3j e 2I2/C h m (viw) — j for at least 2k numbers m 

which leads us to a NCW as on Figures [l] [2] and [4] In this case, automaton 
Bij needs to count to 2k, so it needs 0(k) states. Therefore, the whole NCW 
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Fig. 4. Automaton _B, ; j in the NCW case 



automaton has 6>(fc 3 ) states. Actually, we believe that every NCW recognizing 
Lk indeed needs 0(k 3 ) states. 

Now we are ready to state our main theorem: 
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Theorem 2. Every NCW recognizing has at least k ■ states. 

The rest of this paper is devoted to the proof of this theorem. In subsection 
|2.3|we will define, for each co-Biichi automaton in the normal form, recognizing 



each such set has at least states. As we have seen in subsection 
given NCW with n states we can always build a NCW in the normal for with at 
most 2n states, which finally leads to | • k ■ ^-j— lower bound. 



Lfc a family of k disjoint sets of states, and in subsection |2.5| we will show that 

for a 
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2.3 The k disjoint sets of states 

Let A = (Sk,Q,qo^j a ) be an NCW in the normal form with N states that 
recognizes L^. 

Let Wij = i(j N T, 2,...,i-l,i+l,..., 2k) u , For every i ^ j let q , qjj, qfj, 
qf p ... be a fixed shortest accepting run of A on Wij. 

Words Wi.j will be the main tool in our attempt to fool the automaton if it 
has too few states so let us comment on their structure. First notice, that the i, 
the very first symbol of Wij, will turn into the only in h(w) - this is, among 
other reasons, since for all m ^ i the symbol m occurs infinitely many times in 
w. See also that if we replaced the blocks j N in the definition of Wij by just a 
single j, then the word would still be in Lk - since we do not count promises 
but fulfillments, the remaining j's are almost redundant. It is only in the proof 
Lemma |4jii) that we will need them. In the rest of the proof we will only be 
interested in one state of A per each such block of symbols j. For this reason we 
define block(l) = N + 1 + l(N + 2k — 1) as the function that points to the index 
of the state in run qo, qj., g? qf p . . . just after reading the 2-th block j N . 

Let o„, {,/';;"*■' <■< X}.' 

Lemma 1. For every m, I f= %2k such that m =/= i =/= j I and m ^ j, the 
sets Qi. m and Q^i are disjoint. 
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Proof. Suppose that there exist i,j,m,l € 2l2fe, and s,t £ AT such that m ^ 
i^j^l, m^j and qf m — q* t . Let v = Wi >m [0, block(s)].Wj t i[block(t) + l,oo]. 



i. in ' 



This word is accepted by ^4, because there exists an accepting run go, q} 

block(s) block{t) + l block(t)+2 f . 

The only letters without the overline in v are i, m and I. However, the only 
overlined letter that does not occur infinitely often in v is j. This letter is different 
from i, m and I because of the assumptions we made. Therefore does not occur 
in h(v) and v L^. □ 

We say that I is huge if I > k and that I is small otherwise. 

For every i let Qi — \J{Qi,j\j is small}. A simple conclusion from Lemma [I] 
is that for each huge i,j such that i ^ j the sets Qi and Qj are disjoint. This 
implies, that Theorem [2] will be proved, once we prove the following lemma: 

Lemma 2. For each huge i £ 2l2fe the size of the set Qi is greater than . 



2.4 Combinatorial lemma 

The nxm state matrix is a two-dimensional matrix with n rows and m columns. 
We say that nxm state matrix is l-painted if each of its cells is labeled with 
one of I colors and the minimal distance between two cells in the same row and 
of the same color is at least m. 

For a painted nxm state matrix, we say that an Mjj is a cell on the left 
border if j = 1, and is on the right border if j = m. We say that Mij is a 
successor of Mj/^' if i — i' and j = j' + 1. 

The path w through a painted nxm state matrix M is a sequence of cells 
ci, C2, . . . , c z such that c\ is on the left border, c z is on the right border, and 
for each s < z either c s +i is a successor of c s (we say that "there is a right move 
from c s to c s +i") or c s and c s +i are of the same color (we say that "there is a 
jump from c s to c s+ i") 

We say that a path w is good, if there are no consecutive k right moves in 
w, and no jump leads to (a cell in) a row that was already visited by this path. 
Notice that in particular a good path visits at most k cells in any row. 

Our main combinatorial tool will be: 

Lemma 3. Let M be an \-painted kx \_^—\ state matrix. Then there exists 
a good path on M . 

The proof of this lemma is left to subsection |2.6| 



2.5 From automaton to state matrix 

We are now going to prove Lemma J5] Let a huge i G 2l2fe be fixed in this 
subsection and assume that \Qi\ < . We will show that there exists a word 
w such that A accepts w and no agent fulfiles its promises at least 2k times in 
w. 

Let j be an small number from ^2k- Let us begin from some basic facts about 

Qi,j - 
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Lemma 4. (i) There exists a number I such that for every s < I the state 

bl0Ck(s) . , . 7 £ ^ T .7 . . bl0Ck(s) . T~l J2 

q i j is not in a ana for every s > I the state q i ■ «s m a. Define 
acc(i,j) = I. 

(ii) No accepting state from Qi can be reached on any run of A before some agent 
fulfilled its promises 2k — 1 times. It also implies that acc{i,j) > 2k — 1. 

/• • • \ rrn -l ± block(Q) block(l) block{acc(i,j)\ ■ ■ 7.™ , 

(my J he states q i j , 3jj T-->Qij are pairwise different. 

Proof, (i) This is since is in the normal form. 

(ii) While reading a block of N symbols j, the automaton is in TV + 1 states, 
so there is a state visited at least twice. If this state was accepting, then a 
pumping argument would be possible - we could simply replace the suffix of 
the word after this block with the word j u and the new word would still be 
accepted, despite the fact that it is not in L^. 

t...\ ri block(s) i block(t) n n . . 

(in) Suppose q i - and are equal and non-accepting. For every s < 

t < acc(i,j), the words Wij[block(s) + 1, oo] and Wij[block(t) + l,oo] are 
identical. Then a pumping argument works again - we can find a shorter 

.. n -,1.1, block(s) block(t) — l t-. . . n . 

accepting run by pumping out the states q i , j . But this 

contradicts the assumption that our run is shortest. □ 

We want to show that \Q t \ > ^-r-. If for any small j there is acc(i,j) > ^-L 1 

then, thanks to Lemma [ijiii) we are done. So, for the rest of this subsection, we 
assume that acc(i,j) < ^-r 1 for each small j. 

We will now construct a L^~J - painted k x J state matrix M in such 
a way, that its m'th row will, in a sense, represent the accepting run on the 
word u>i i?n . More precisely, take a k x L^r~J matrix M and call the cells M mj 
of M, where j < acc(i,m), real cells and call the cells M m j of M with j > 
acc(i, m) ghosts. For a ghost cell M m j and the smallest natural number I such 
that j — Ik < acc(i,m) call the real cell M/m^j — Ik) the host of M m j. Notice 
that each ghost has its host, since, by Lemma [4] (ii) , acc(i,m) > 2k — 1, which 
means that there are at least k real cells in each row. 

If M m j is real then define its color as q\ 1 ^ ■ If M m j is a ghost then 

define its color as the color of its host. Now see that M is indeed a L^i~J " 

painted k x L^~i~J state matrix - the condition concerning the shortest distance 
between cells of the same color in the same row of M is now satisfied by Lemma 
[4] (iii) and the condition concerning the number of colors is satisfied, since we 
assume that \Qi\ < . 

By Lemma [3] we know that there is a good path in M. This means that 
Lemma [2] will be proved once we show: 

Lemma 5. If there exists a good path in M , then there exists a word w $ 
such that w is accepted by A. 

Proof. Suppose r is a good path in M and c is the first ghost cell on r. Let d 
be the direct predecessor of c on r. If the move from d to c was a right move 
then define a new path p as the prefix of r ending with c. If the move from d 
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to c was a jump, then suppose c" is the host of c, and define p as the following 
path: first take the prefix of r ending with d . Then jump to c" (it is possible, 
since the color of a ghost is the color of its host). Then make at most k — 1 right 
moves to the last real cell in this row. 

It is easy to see that p satisfies all the conditions defining a good path, except 
that it does not reach the right border of M. 

Let p be a concatenation of words pi,p2 ■ ■ -,p z , such that each move between 
p x and Px+i is a jump but there are no jumps inside any of p x . This means that 
each p x is contained in some row of M, let (3(x) be a number of this row. This 
also means, since p is (almost) a good path, that \p x \ < k for each x. 

Let Vi = 1, 2, . . . ,i — l,i + 1, . . . , 2k. Now define an infinite word w as follows: 

w = i/3(l) iV M(l) JV )l J,I l- 1 M(2) jV )l^l- 1 . . . {v i 0(z) N )b"\- 1 0(z) u 

To see that w £ notice, that a symbol s € 2l2fc occurs in h(w) only if 
s = (3(x) for some x € {1, 2 ... z} and that it occurs at most \p x \ + 1 < k times in 
w. The fact that A accepts w follows from the construction of path p and from 
Lemma [I] (ii) . □ 

2.6 Proof of the combinatorial lemma 

Let n = J and M be an n-painted k x n state matrix. We split the matrix 
M into matrices M^M 1 , M l"irl ~ 1 , each of them of k rows and each of them 
(possibly except of the last one) of | columns, such that M l contains columns 
if + l,if + 2... ,min(i| + |,n). The matrices M°,M l , ...,M^^~ 2 will be 
called -multi columns. 

We are going to build a path w = c\C2 ■ . ■ c z through M satisfying the fol- 
lowing: 

— if w has a jump from Cj to Cj+i then both Cj and Cj+% belong to the same 
multicomumn; 

— w has exactly — 1 jumps, one in each multicolumn; 

— no jump on w leads to a previously visited row of M. 

Clearly, such a path will be a good path. This is since the width of each 
multicolumn is |, and each sequence of consecutive right moves on w will be 
contained in two adjacent multicolumns (except of the last such sequence, which 
is contained in the last multicolumn and mTt! -1 ). 

Let s — — jf-. Since \s] — \ 2 k k > \jr~\ , the number \s] — 1 is not smaller 
than the number of jumps we want to make. 

Now we concentrate on a single multicolumn M l , which is a matrix with k 
rows and with | columns. We will call two rows of such a multicolumn brothers 
if at least one cell of one of those rows is of the same color as at least one cell 
of another (i.e. two rows are brothers if a path through M % can make a jump 
between them). 
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Suppose some of the rows of the multicolumn M % belong to some set D l of 
dirty rows. The rows which are not dirty will be called clean. A color will be 
called clean if it occurs in some of the clean rows. A row will be called poor if it 
has less than \s\ clean brothers. One needs to take care here - in the following 
procedure, while more rows will get dirty, more rows will also get poor: 
Procedure (Contaminate a single multicolumn(_D l ,ikP) ) 

while there are clean poor rows (with respect to the current set D l of 
dirty rows) in M % , select any clean poor row and all his brothers, and 
make them dirty (changing D l accordingly), 
end of procedure 

We would like to know how many new dirty rows can be produced as a result 
of an execution of the above procedure. 

Each execution of the body of the while loop makes dirty at most \s] rows 
and decreases the number of clean colors by at least | - none of the colors 
of the selected clean poor row remains clean after the body of the while loop 
is executed. Since there are at most n colors in the multicolumn (as M is n- 
colored), the body of the while loop can be executed at most -A^ < \s~\ times, 
which means that at most |~s] 2 new dirty rows can be produced. 

Notice that after an execution of the procedure, none of the clean rows is 
poor. 

Now we are ready for the next step: 
Procedure (Contaminate all multicolumns) 
Let D^l-i = ; 
for i = l" 2 ^] 2 down to 
Let D l = D l+1 ; 

Contaminate a single multicolumn(D I ,M I ); 
end of procedure 

We used a convention here, that a set D l of rows is identified with the set of 
numbers of those rows. Thanks to that we could write the first line of the above 
procedure, saying "consider the dirty rows of M l+1 to be also dirty in M m . 

Suppose D°,D X . . .Z?rirl~ 2 are sets of dirty rows in multicolumns M°,M 1 , 
. . ., M^tI _2 resulting from an execution of the procedure Contaminate all mul- 
ticolumns. Notice, that for each < i < \^jf \ — 2 the inclusion D t+1 C D l holds. 
In other words, if a row is clean in M 1 , then it is also clean in M l+l . 

The following lemma explains why clean rows are of interest for us: 

Lemma 6. Suppose w = c\Ci ..-Cz is a path through the matrix consisting of 
the first i multicolumns of M (or, in other words, of the first ^ columns of M). 
Suppose (i) w has exactly one jump in each multicolumn, and each jump leads 
to a row which was not visited before, (ii) if there is a jump from Cj to Cj+i then 
both Cj and Cj+\ belong to the same multicomumn. Suppose finally, that (Hi) 
the cell where w reaches the right border of the matrix, belongs to a clean row 
r. Then w can be extended to a path through the matrix consisting of the first 
i + 1 multicolumns of M, in such a way that this extended path will also satisfy 
conditions (i)-(iii). 
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Proof. The only thing that needs to be proved is that one can jump, in multi- 
column M % , from row r to some clean row which was not visited before. Since, 
by assumption, r was clean in M'" 1 , it is also clean in M l . Since there are no 
clean poor rows in M l , we know that r has at least |Y| clean brothers. At most 
i of them were visited so far by the path, where of course i < \s] — 1. □ 

Now, starting from an empty path and a clean row in M° and using the above 
lemma \^r~\ — 2 times we can construct a path w as described in the beginning 
of this subsection and finish the proof of Lemma [3] The only lemma we still need 
for that is: 

Lemma 7. \D°\ < k. In other words, there are clean rows in M°. 

Proof. Let I = [s] — 2 be the index of the last multicolumn. The number of dirty 
rows in D l ~ l can be bounded by (i + 1) • |~s] 2 because of observations about 
defined procedures. For i = I, we have (|~s] — 1) • |~s] 2 , what is not greater then 

s(s + l) 2 = ^—(^r- + l) 2 which is, finally, less then k, because k > 8. □ 
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